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1.  INTRODUCTION 


Majority  vote  Is  a  decoding  scheme  used  to  enchance  signal  transmission 
In  Information  theory.  Binary  signals  are  sent  over  a  channel  (called  a 
binary  symmetric  channel)  In  which  each  signal  Is  correctly  received  with 
probability  p.  To  Increase  the  probability  of  correct  reception,  each  bit 
Is  repeated  2k-l  times,  and  the  bit  Is  decoded  as  the  majority  vote,  l.e. 
the  signal  (zero  or  one)  which  Is  received  at  least  k  times. 

If  p  >  1/2,  the  majority  vote  scheme  can  produce  transmission  accuracy 
which  Is  arbitrarily  good  by  choosing  k  to  be  large  enough.  Define  the 
probability  that  the  majority  vote  Is  correct  as 


r2k-l^  j,,  x2k-l-j 
p„  -  I  C  .  j  p-'d-p) 
j-k  J 


(1.1) 


Then  p  1  as  k  and  as  long  as  p  >  1/2  and  k  >  1,  p  >  p.  See  McKllece 
m  m 

(1977),  p.  3  for  proofs  and  further  discussion. 

Puthoff  (1984)  recently  conducted  an  experiment  In  which  the  majority 
vote  technique  was  used  to  try  to  enchance  signal  transmission  via  ESP. 
Theoretically,  the  Idea  of  the  experiment  was  that  for  each  of  n  repetitions, 
a  percipient  (the  teim  parapsychologists  prefer  Instead  of  "subject")  would 
make  five  Independent  guesses  as  to  the  red/black  outcome  of  a  single  spin 
of  a  roulette  wheel.  The  response  chosen  at  least  three  times  would  be 
recorded  as  the  percipient's  guess  for  that  repetition,  thus  the  guess 
would  be  the  majority  vote  of  five  trials. 


The  actual  experiment  was  slightly  more  complicated,  for  two  reasons. 
First,  If  percipients  were  asked  to  guess  the  same  target  five  times,  they 
would  probably  repeat  the  same  answer  five  times,  and  the  concept  of  five 
Independent  repetitions  would  be  completely  negated.  Second,  the  majority 


□ 

□ 


Codes 

,  Avail  and/or 
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vote  decision  could  be  reached  In  as  few  as  three  trials,  so  the  extra 
guesses  would  be  extraneous. 

The  actual  experiment  proceeded  as  follows.  The  experimenter  spun  the 
roulette  wheel.  Immediately  closing  the  drawer  In  which  It  was  kept  before 
It  stopped  spinning,  so  that  he  did  not  know  the  outcome.  Thus,  the 
experiment  was  designed  to  detect  clairvoyance,  extrasensory  knowledge  of 
objective  events,  and  not  telepathy.  The  percipient  was  given  an  HP-41C 
calculator  which  was  programmed  In  advance  to  randomly  assign  the 
designations  ’’red'*  and  "black**  to  two  preselected  keys.  The  random 
assignment  was  made  for  each  Individual  trial.  Thus,  the  percipient's  job 
was  to  push  whichever  of  the  two  keys  "felt  right"  for  each  trial.  The 
calculator  kept  an  Internal  tally  of  the  number  of  times  "red"  and  "black" 
had  been  guessed,  and  terminated  the  sequence  when  three  of  one  or  the  other 
had  been  accumulated.  The  percipient  then  handed  the  calculator  to  the 
experimenter,  who  opened  the  drawer,  compared  the  calculator  result  with 
the  correct  color,  and  told  the  percipient  whether  or  not  the  majority  vote 
had  been  successful.  We  will  return  to  this  example  momentarily. 

In  general,  consider  an  experiment  which  consists  of  n  repetitions  of  a 
randomly  stopped  Bernoulli  sequence,  where  each  sequence  Is  stopped  at  the 
kth 

success  or  k^^  failure,  whichever  comes  first.  Another  example  of  such 
an  experiment  might  be  one  In  which  n  poll  takers  each  sample  individuals 
until  they  get  either  k  affirmative  responses  or  k  negative  responses  to 
some  question. 

The  main  goal  In  such  experiments  would  usually  be  to  make  Inferences 

about  p,  the  per  trial  probability  of  success.  However,  there  may  be 

Instances  where  the  goal  Is  to  make  Inferences  about  p  ,  the  probability  of 

n 

correct  majority  vote.  Notice  that  p^  Is  also  the  probability  that  an 
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individual  sequence  ends  with  a  ’’success”,  since  each  sequence  is  termlnaCed  at 

the  success  or  failure,  whichever  comes  first. 

In  the  ESP  experiment,  the  second  goal  was  of  interest  because  the  whole 

idea  of  the  experiment  was  to  try  to  Increase  the  overall  probability  of 

correct  reception  through  repetition.  One  way  to  approach  this  goal  might  be 

to  estimate  p,  and  then  use  (1.1)  to  estimate  p  .  However,  with  the 

01 

experimental  setup  used.  If  paranormal  abilities  do  exist  they  may  operate 
on  the  sequence  as  a  whole,  and  the  trials  may  not  be  Independent  so  that 
Inferences  about  p  would  be  made  without  the  Independence  assumption. 

Q 

The  remainder  of  the  paper  is  divided  into  four  sections.  In  Section  2, 
the  experiment  Is  modeled  In  two  different  ways.  In  Section  3  we  determine 
the  maximum  likelihood  estimator  for  p  and  study  Its  properties.  Other 
estimators  of  p  and  p  are  derived  In  Section  4,  and  the  ESP  experiment  Is 

IB 

analyzed  In  Section  5. 


2.  APPROACHES  TO  THE  PROBLEM 

The  experiment  described  above  can  be  modeled  In  various  ways.  We 

consider  It  first  as  a  sequence  of  Bernoulli  trials,  and  then  as  a  multinomial 

experiment.  Although  the  models  are  theoretically  the  same,  they  are 

conceptually  and  notatlonally  different,  and  It  Is  Interesting  and 

mathematically  convenient  to  consider  both. 

Let  (Y^,  T^)  be  the  number  of  successes  and  the  number  of  trials, 

respectively,  needed  to  achieve  either  k  successes  or  k  failures  for  sequence 

1,  l>l,...,n.  Let  (Y,T)  be  the  generic  random  vector  representing  the  l.l.d. 

n  n 

random  vectors  (Y^,  Tj^).  Further,  let  Y*  •  2  Y^  and  T*  -  Z  Tj  be  the 

1-1  1-1 

total  number  of  successes  and  trials,  respectively,  for  the  entire  experiment. 
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Define  _  ;  •••  ;  Z^i . Z  _  as  Che  actual  randomly  stopped 

i-ij  nijj 

Bernoulli  sequences;  Chen  It  Is  Immediately  obvious  that  Ti,...,Tn  and  T*  all 

Tl 

fit  the  definition  of  stopping  times.  Also  -  Z  Z^y,  1-1,..., n,  and 

^  n  Ti 

Y  -  £  Z  Z±A  are  all  randomly  stopped  sums.  Ue  use  these  facts  In 

1-1  J-l 
Section  3. 

Ue  can  also  model  Che  experiment  as  multinomial,  with  each  of  Che  n 
sequences  falling  Into  one  of  2k  possible  categories.  The  category  Is 
determined  by  the  length  of  the  sequence  (k,k4’l, . . . ,2k-l) ,  and  whether  It  ended 
In  success  or  failure.  Let  X  -  (Xj ,X2 , . . . ,X2it) '  be  the  2kxl  vector  of 
multinomial  counts,  where  X2j-i  -  number  of  sequences  with  exactly  k  failures 
and  (j'-l)  successes  and  X2j  *  number  of  sequences  with  exactly  k  successes  and 
(J-l)  failures,  J-l,...,k.  For  example,  Xj  and  X2  represent  the  numbers  of 
sequences  composed  of  all  failures  and  all  successes,  respectively. 


Note  Chat  £  (X2j— 1  +  X2j)  -  n. 

J-l 

Define  the  corresponding  vector  of  multinomial  probabilities  as  x^,  using 
Che  same  subscripts.  Thus,  we  obtain  Che  cell  probabilities: 

-  P(k  failures,  J-l  successes,  ending  with  failure) 

,k  +  J-2^  J-l  k 

-  (  j.!-"  J  p-*  q  ; 

(2.1) 


2J 


P(k  successes,  J-l  failures,  ending  with  success) 
k  +  J-2^  k  J-l 

n'  n'*  ♦ 


1  J-l  J 


p-  q 


J  -  1. 


,k,  where  q  -  1  -  p. 
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We  can  relate  the  two  models  by  noting  that 

k 

Y*  -  r  KJ-l)  X21-1  +  kX2jI 

J-1 

and  (?.2) 

k 

T*  -  2  (k  +  J-1)  (X2j-i  +  X21). 

J-1 

In  the  next  few  sections  we  will  utilize  both  models  as  necessary. 

3.  MAXIMUM  LIKELIHOOD  ESTIMATOR 

Since  maximum  likelihood  estimators  based  on  data  sampled  with  random 
stopping  rules  are  Identical  to  those  for  fixed  sampling.  It  follows  from  the 
Bernoulli  model  that  the  MLE  of  p  Is 

p  -  Y*/T*.  (3.1) 

From  (2.2)  we  obtain  the  relationship: 

k  k 

P  5  g(X)  -  2  [(J-l)X2j-i  +  kXjjl/  2  [(k+J-l)(X2j-i  +  X21)].  (3.2) 

J-1  J-1 

3.1  Preliminary  Results 

We  state,  as  lemmas,  some  well  known  results  which  will  be  used 
to  prove  the  asymptotic  normality  of  p. 

Lemma  3.1:  If  X  has  a  multinomial  distribution  with  n  trials  and  probability  . 
vector  x_,  then  n  ^  -->  MVN  (x_,  2)  where  2  -  {oij}  Is  a  singular  matrix 
with  Ojj  ■  Xj(l-Xj^)  If  1-J  and  if  i^J* 

Proof:  This  follows  from  the  multivariate  Llndeberg-Levy  Central  Limit 
Theorem.  See  e.g.,  Serfllng  (1980,  p.  108). 
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Lennwa  3.2  (Delta  method);  Let  ^  be  an  S-dlmenslonal  random  vector  such 

that  /n“  5ji  — >  MVN(Q^,2:).  Let  f(Oji)  be  a  function  from  ^  to 

differentiable  at  2n  "  2.»  |o  qJ  *  ''^*a  “  f(Q.)) 

dQl  lii  ii 

— >  N(0,  d*  Z  d). 

Proof:  See  e.g.,  Bishop,  Fienberg  and  Holland  (1975,  p.  493). 

Lemma  3.3  (Wald’s  equation):  If  Z^,  1>1,  are  1.1. d.  random  variables  with 

T 

E|z|  <  «",  and  T  Is  a  stopping  time  for  Z^,  Z2,...,  then  e(  Z  Zj)  ■  F(T)  E(Z). 

1-1 

Proof :  See  e.g.,  Ross  (1983,  Corollary  7.2.3) 

Lemma  3.4:  Let  1>1,  be  l.l.d.  random  variables  with  E(W)  -  0  and 

E(W^)  -  <  -.  If  T  Is  a  stopping  variable  and  Sy  la  the  corresponding 

2 

randomly  stopped  sum,  then  E(S^)  -  <J^E(T)» 

Proof :  See  Chow,  Robbins  and  Telcher  (1965,  Theorem  2). 


The  Asymptotic  Distribution  of  the  MLE 


Ue  are  now  ready  to  prove: 


Theorem  3.1:  For  the  experiment  described  above,  p  -  Y*/T*  Is  asymptotically 
N(p,  pq/E(T*)),  i.e.,  /T  (J-p)  — >  N(0,pq/ET). 


Proof :  Let  n”^X,  so  (3.2)  can  be  represented  as  p  -  g(X)  =  f(x^).  Combine 

Lemma  3.1  and  Lemma  3.2,  with  ^  -  n,  f(2n)  ■  f(i,)  ■  Pi  2.  *  2L»  ^  given  by 

df(i) 

Lemma  3.1  and  the  it±  In  formula  (2.1),  and  d  -  f - 1  “  _  ,]•  This  results  in: 

Slj  i  !■ 
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p  is  asymptotically  N(f(ii),  n  d'  Z  d). 


(3.3) 


k  k 

Next  note  that  -  Z  2  (k+j-1) 

■  E(Y)/E(T).  Apply  Lemma  3.3  with  Zj^  —  Bernoulli  (p),  and  T  the  stopping 
time  for  an  Individual  sequence,  to  get  E(Y)  ”  pE(T),  and  thus  f(iO  ■  p. 

To  detenalne  the  asymptotic  variance  In  (3.3),  note  that  Z  ■  [dlag.  ti_ - 
XX* 1 .  where  dlag.  x^  Is  a  2k  x  2k  matrix  with  the  elements  of  on  the  diagonal 
and  0  elsewhere.  Also,  using  the  notation  d^j  ^  and  d^^  to  correspond  to  the 
elements  of  d,  we  find 


‘*2j-l  *  "  P(>t+J-l)l/E(T) 

dij  -  [k-p(k-»-J-l)]/E(T). 

Thus,  d *  J  d  -  d'Cdlag  x )  d  -  (£'x)^ 


(3.4) 


(3.5) 


But  notice  from  (3. A)  that  for  each  of  the  2k  multinomial  outcomes,  the 
numerator  of  the  corresponding  element  of  ^  is  simply  [#  successes  - 
p(#  guesses)].  Thus,  (3.5)  can  be  rewritten  as 

[E(Y-pT)^  -  (E(Y-pT)]^J/[E(T)J^  -  E(Y-pT)^/[E(T) (3.6) 
since  E(Y)  -  pE(T). 

We  now  Invoke  Lemma  3. A.  Let 


q  If  trial  1  Is  a  success 

Wl  - 

-p  If  trial  1  is  a  failure 
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Then  E(W)  ■  pq  “  pq  ■  0,  E(W^)  -  pq^  +  p^q  ■  pq,  and  Sf  ■  Z  Wj  ■  qY  -  p(T-Y) 

1-1 

-  Y-pT.  Thus,  from  Lemma  3.4, 

E(sJ)  -  E(Y-pT)^  -  E(tf^)E(T)  -  pqE(T).  (3.7) 

Combining  (3.5),  (3.6),  and  (3.7),  Z  d  -  pq/E(T).  Since  E(T*)  -  nK(T),  we 
have  from  (3.3),  p  la  asymptotically  N(p,  pq/E(T*)). 

3.3  Computational  Formulas  for  E(T) 

To  use  Theorem  3.1  for  Inference,  we  require  an  expression  for  E(T*)  for 
fixed  p  and  k.  Although  the  definitional  formula  given  by  (3.11)  below  Is 
computable.  It  Is  Interesting  to  note  that  It  can  be  rewritten  In  the 
computational  form  (3.9),  via  the  recursion  In  (3.3).  In  particular,  the 
closed  form  expression  (3.10)  can  be  used  when  p  »  .5,  as  In  the  ESP  example. 
To  show  the  dependence  on  k.  we  write  ET  as  E(T)f).  The  redundancy  of  this 
notation  with  E(Ti)  used  earlier  should  not  cause  confusion,  slr-ce  the 
distinct  roles  of  the  subscripts  1  and  k  remain  fixed  throughout  the  paper. 


Theorem  3.2; 


E(T^^l)  -  (k+l)k"^  E(T^)  +  (J*")  (pq)'" 


and 


E(T  )  -  k  Z 
J-0 


When  p  -  .5,  E(T^)  -  2k[  l-(  J'')/4’'l . 


Proof;  E(T^)  -  Z  (k+j-1)  (it2j-i  *  ’*23^ 


k-1 


-  k  Z  (p^q'^  +  p'^q^)  ■  kS(k). 

J-0  ^ 


def 


(3.8) 

(3.9) 

(3.10) 


(3.11) 
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Now  we  will  show  that 

(pq)"’"[S(k+l)  -  S(k)l  -  (k+1)"^  (3.12) 

Using  the  facts  that  ^J-1^  (p^  *^9  "*■  Pq^  “  ( P^  ^  9^ 

-  (p^  write  (pq)  ^  S(k+1)  in  three  pieces: 

(pq)"'‘  S(k+1)  -  Z  (p^"\  +  pq^"'") 

J-0  J 

-  r  (p^"'^  +  (3.13) 

j-0  J 

+  ^  (vJ)  (P^”'"  +  (3.U) 

j-1  J 

-  Z  ^  9^""^')  (3.15) 

J-0  ^ 

Note  that  (3.13)  is  simply  (pq)  S(k)  + 

Also,  by  rewriting  (3.15)  so  that  the  summation  is  from  j-1  to  j-k+1, 

7V+1  —W 

(3.14)  and  (3.15)  combine  to  give  “  (|^  )•  Hence,  (pq)  (S(k+1)- 

S(k))  -  -  (k+l)”^  thus  verifying  (3.12). 

From  (3.12),  we  have  E(T^^^^)  -  (k+l)S(k+l)  -  (k+l)R(k)  +  (pq)*"  - 

(k+l)k"^E(Tj^)  +  (^*^j(pq)*^.  thus  verifying  (3.8). 

Now  use  induction  to  show  (3.9).  Since,  K(Tj^)  -  1,  (3.9)  holds  for  k-1. 
Suppose  E(Tj^)  can  be  written  as  in  (3.9).  Then  from  (3.8),  E(T^j^)  -  (k+l)k  ^ 
E(T^^)  +  (^'‘j(pq)*‘,  which  is  precisely  (3.9)  for  E(T^j^). 
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For  the  special  case  p  >  .5  Invoke  the  combinational  identities 

2"^^  -  r(J  +  .5)//“  r(j+l);  (3.16) 

see  Abramowltz  and  Stegun  (1964,  p.  258,  6.1.49);  and 

rO-hn)/r(a-hn)  =  (p-a+l)“^ 

see  Mangulls  (1965,  p.  60,  24).  Start  with  (3.9)  for  p  ■  .5,  apply  (3.16),  then 
use  (3.17)  with  ^  ■  .5  and  a  *  2,  and  finally  use  (3.16)  again,  resulting  in  the 
formula  (3.10).  // 

If  tables  of  the  incomplete  beta  function  are  available,  we  can  use  those 
to  compute  ET.  Note  that 

S(k)  -  2  (pJq*^  +  p'^q^) 

J-0 

.2-2  (pV^-pV). 

J-k  J 

But  2  p^q^"^^  .  Ip(r,  k+1).  Thus,  S(k)  -  2  -  q"^  Ip(k,  kfl)  -  p"4q(k,k+l) 

J-r  ^ 

and  E(T^)  *  kS(k). 

It  is  interesting  to  note  that  S(k)  is  a  partial  sum  of  the  Catalan  number 

OD 

generating  function,  C(x)  *  (l  -  /l-4xj/2x  *  2  (j+l)”^(?^)  x'^;  see  Rlordan  (1968). 

j-O  ^ 

Also  note  that  for  large  k,  (3.10)  can  be  approximated  by 

E(Tj^)  .  2k  -  2(k/x)^^^,  (3.18) 

using  Stirling's  approximation. 

3.4  Bias  of  the  MLE 

Unlike  in  the  corresponding  fixed  sample  size  problem,  the  MLE  p  is  biased. 

The  general  form  of  bias  is  Cov(T*,  p)/ET*,  since  Cov(T*,  p)  *  Cov(T* ,Y*/T*) 


■  EY*  -  ET*Ep  ■  pET*  -  ET*Ep  ■  (ET*)(blas).  To  give  some  notion  of  the 
complexity  of  this  formula,  note  that  when  n-1  we  find 


bias  ■  pq(q-p)/3 


for  k»2 


bias  «  pq(12pq+5)(q-p)/20  for  lc»3. 

In  general,  bias  <  0  when  p  >  .5,  bias  >  0  when  p  <  .5.  When  p  >  .5,  bias 
This  Is  clear  since  E(^q)  -  e[(Y*/T*)  +  (T*“Y*)/T*J  ■  1,  but  when  p  *  .5 
Ep  »  Eq,  so  Ep  »  .5  ■  p. 


4.  OTHER  ESTIMATORS 


One  way  to  find  an  unbiased  estimator  Is  to  find  one  for  each  sequence, 
then  average  over  the  n  sequences.  Note  that  (Yj^,  Tj^)  Is  a  minimal  sufficient 
statistic  for  p,  for  sequence  1.  Also,  EiZu)  «  p.  Thus,  an  unbiased  estimator 
for  p  based  on  one  sequence  Is 


5si  -  ■'i) 


If  Yj^  <  k. 


An  unbiased  estimator  of  p  Is  thus 


”  if: 


Notice  that  p^  Is  based  only  on  what  Kremers  (1985)  calls  the  '’preterminal* 
data,  l.e.,  the  trials  before  the  stopping  trial.  In  particular,  p^^ 

•  (£  preterminal  preterminal  trials. 

An  obvious  analog  of  p^^  based  on  all  of  the  preterminal  trials  is  p^^  > 
(Y*-n^)/(T*-n)  ■  (#  preterminal  successes)/#  preterminal  trials,  where  n^  ■ 
number  of  sequences  ending  In  success.  But  notice  that  p^^  Is  not  even 
asymptotically  unbiased.  Rewriting  It  as 
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a 

S  (j-DX,.  ,  +  (k-l)X,. 

j-1 _ _ zi 

PoT  "  “ 

P"  ^Z^(lc+j-2)(X2j.j  +  X^j) 

and  applying  Lemmas  3.1  and  3.2,  we  find  E(n  )  — >  E(Y*-n  )/E(T*-n).  But 

pi  8 

E(Y*-n  )  ■  n(pET-p  )  and  E(T*-n)  ■  n(ET-l),  where  p  Is  given  by  (1.1).  Thus, 
s  m  m 

asymptotically,  E(p  _)  <  p  Iff  p  /p  >  1,  l.e..  Iff  p  >  and 

pT  IB  Z 

E(Pp^)  >  p  Iff  p  <  j. 

Finally,  consider  estimating  p  .  In  particular,  suppose  that  we  are  not 

fli 

willing  to  asstime  that  trials  are  Independent  Bernoulli,  but  rather  that 
sequences  are  Independent  and  fall  into  one  of  the  2k  multinomial  outcomes.  As 
mentioned  In  the  Introduction,  this  may  be  a  more  reasonable  assumption  In  the 
ESP  experiment,  since  paranormal  abilities,  If  they  exist,  may  operate  on  the 
entire  sequence  as  a  whole. 

With  this  assumption.  Inferences  about  p  are  now  simply  Inferences  about 

(B 

the  binomial  probability  that  the  majority  vote  result  Is  a  success.  Thus,  the 

1  k 

best  estimator  for  p  Is  simply  p  •  —  Z  X-,  and  Its  variance  Is  p  (1-p  )/n. 

m  m  n  ^  ^ 

5.  ESP  EXPERIMENT 

The  experiment  described  In  the  introduction  was  carried  out  with  k  >  3  and 

n  «  100,  for  three  percipients.  Results  are  shown  In  Table  1.  Ue  would  like  to 

test  the  hypothesis  that  p  ■  .5.  From  (3.10),  ET*  *  412.5.  Also,  Var(p^)  *  .027, 

derived  by  writing  out  Its  distribution  for  p  *  .5,  k  «  3,  n  -  100.  Table  1  also 

gives  values  of  the  test  statistic  Z  based  on  the  three  estimators  p,  p^,  p^. 

Notice  that  In  each  case  p^  <  p,  which  would  be  expected  to  be  the  trend 
1 

If  p  >  y,  since  p  Is  biased. 


It  Is  also  Interesting  to  see  If  the  Independence  assumption  Is  reasonable 
for  the  data.  Table  2  presents  the  results  for  two  sets  of  chi-square  tests.  For 
the  first  set,  HQtGuesses  are  Independent,  p  ■  .5  was  tested,  and  for  the  second 

A 

set  p  was  used  In  place  of  .5,  so  that  just  the  Independence  hypothesis  was  being 

tested.  Notice  that  the  results  Indicate  that  the  Independence  assumption  seems 

reasonable  for  all  three  percipients,  but  the  assumption  that  p  *  .5  Is 

questionable  for  two  of  them.  The  Z  tests  also  support  this  conclusion. 

One  curious  result  Is  that  percipient  #2  had  about  the  expected  number  of 

sequences  of  length  5,  but  the  split  between  ending  In  success  and  ending  In 

failure  was  27  to  12  Instead  of  about  half  of  each.  This  led  to  Z  >  2.00  for  the 
test  of  Pq  *  1  whereas  both  tests  of  p  ■  .5  resulted  In  nonsignificance.  The 

parapsychologists  used  this  as  evidence  that  a  test  based  on  p  would  be  more 

m 

powerful  than  one  based  on  p.  This  Is  clearly  not  true  If  the  Independence 

assumption  Is  valid,  since  the  test  based  on  p  results  In  loss  of  Information. 

m 
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